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FOREWORD 

The  area  of  Sonobuoy  performance  prediction  is  of  vital  Importance  for  continued  im¬ 
provement  in  our  Antisubmarine  Warfare  (ASW)  capabilities.  As  part  of  the  Naval  Ocean¬ 
ographic  Office's  investment  in  ASW.  the  Environmental  Systems  Division  specializes  in 
on-scene  predictions.  This  report  identifies  the  major  on-scene  sonobuoy  performance 
prediction  programs  and  analyzes  the  characteristics  of  each.  This  information  should 
prove  a  valuable  contribution  to  future  fleet  Improvements  in  on-scene  prediction. 


C.  H.  Bassett 
Captain,  USN 
Commanding  Officer 
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Mar.'  Ii  :i:ii  n  >  ill  i  :k-I  ii-iil  programs  ADI  |>s(  TASI)A,  A/.(  )|  ami  SPAM  arc  comparable, 
-'inn  ar<  not,  I  nch  mI' t  hi  -  programs  nlTcrs  different  ;i(lv:ml;i^ts  in  user  Input «  eompnia- 
t : <  ■  * i  !  i n ; i  ,  ami  on t pi 1 1  measure  of  t -ft*  i-t  i \  eness,  I'ltis  report  ( lt-st- ri lic-ss  the  eomparable 
ami  a ; i i 1 1 1 1 1  leature-  "I  eaeh  program.  No  attempt  has  been  made  to  evaluate  the  accuracv 
ot  output  values. 


In  an  open  environment  where  there  is  little  or  no  information  about  the  target,  the 
simulation  programs  give  varying  results.  The  data  in  this  report  show  that  these  programs 
evaluate  probability  of  detection  (P<>D)  differently  for  the  same  set  of  patterns  anc!  input 
values.  By  analyzing  cumulative  POO  curves  there  are  general  relationships  that  can  be  ob¬ 
served  between  the  models:  (1)  TASDA  tends  to  be  conservative  in  comparison  with  AZ(  M 
and  SPAM  at  low  figures  of  merit  since  it  assigns  a  POD  of  0  or  1  during  a  Monte  Carlo  trial. 
(2)  SPAM  is  the  most  optimistic  of  the  three  at  low  figures  of  merit  since  it  uses  a  cumula¬ 
tive  time  window  tuul  a  weighted  average  to  obtain  POD.  (3)  At  all  frequencies  and  I'OMs, 
AZOI  shows  small  variance  between  probability  values  for  each  of  the  patterns  since  the 
cttlculation  of  POD  is  time  independent.  (4)  SPAM  is  more  conservative  in  its  POD  values 
at  high  I'OMs  since  the  cumulative  time  window  builds  detection  probabilities.  (5)  Both 
AZol  and  TASDA  have  a  sharp  broakoff  point  for  FOM  below  which  POD  values  decline 
rapiiliv  to  zero  because  of  the  probability  ot  detection  vs.  range  curves  used  in  each 
model.  Output  lor  ADKPS  was  not  analyzed  since  the  number  of  patterns  it  evaluates  is 
limited  and  the  output  is  a  conditional  probability  of  detection.  Differences  between  com¬ 
puter  models  need  to  be  investigated  further.  However,  further  investigation  should  be 
based  on  a  real  world  application  of  the  sonobuoy  programs. 


I. 


LNTKODl'CTION 


Deciding  on  a  "best"  pattern  is  not  an  easy  task.  Ideally,  after  input  of  all  available 
data  and  execution  of  a  sonobuoy  program,  program  output  provides  an  optimal  sonobuoy 
pattern.  There  are,  however,  mnnv  complex  decisions  to  make  in  specifying  a  pattern 
including: 


where  to  drop  each  sonobuoy, 

number  of  sonobuovs  to  drop  in  a  pattern, 

snnobunv  depth  settings. 


length  of  time  to  monitor  a  pattern,  and 
number  of  patterns  to  drop. 


All  of  these  decisions  are  interrelated.  For  example,  the  number  of  patterns  depends  on 
the  size  of  the  search  area,  (lie  aircraft  on-station  time  and  the  availability  of  other  air¬ 
craft.  Additionally,  the  number  of  buoys  required  for  a  particular  pattern  depends  on 
sonobuoy  depth  settings  and  monitoring  time  for  each  buoy.  Operational  constraints  and 
mission  goals  must  also  be  considered  to  provide  the  decision  maker  with  the  best  possible 
choices  for  each  decision. 

Four  of  die  tactical  sonobuoy  computer  programs  which  aid  in  these  decisions  were  in¬ 
vestigated  to  determine  their  functional  effectiveness  as  an  aid  to  planning  search  patterns. 
The  programs  studied  were: 

1.  Tactical  Sonobuoy  Decision  Aid  (TASDA) 

2.  Algorithm  for  Zone  Optimization  and  Investigation  (AZOI) 

,1.  Search  Pattern  Assessment  Model  (SPAM) 

-1.  Automated  Deployment  of  Sonobuoy s  (ADEPS) 

This  report  provides  a  description  of  the  simulation  techniques  used  in  each  model  in  Sec¬ 
tion  II.  Input  parameters  of  target  intelligence,  environmental  data,  buoy  data,  and  aircraft 
characteristics  are  compared  in  Section  III  followed  by  a  discussion  of  computer  output  from 
four  scenarios  in  Section  IV.  Sonobuoy  pattern  definition  is  included  in  Appendix  A.  The 
propagation  loss  environment  is  described  in  Appendix  B.  Output  data  analyzed  for  this  re¬ 
port  are  included  in  Appendix  C . 
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II. 


DESCRIPTION  OF  COMPUTER  SIMULATION  MODELS 


The  tactical  programs  ADEPS,  TASDA,  AZOI  and  SPAM  provide  measures  of  effective¬ 
ness  for  sonobuoy  patterns.  ADEPS  uses  a  mathematical  technique  based  on  the  symmetric 
properties  of  certain  sonobuoy  fields  to  calculate  conditional  probability  of  detection.  The 
other  models,  TASDA,  AZOI  and  SPAM,  use  Monte  Carlo  simulation  techniques.  In  these 
latter  three  models  satistical  distributions  are  used  to  simulate  initial  target  location.  If 
target  position  and  speed  can  be  estimated,  a  normal  statistical  distribution  is  used,  other¬ 
wise,  a  uniform  statistical  distribution  is  used  and  the  target  is  considered  equally  likely  to 
be  anywhere  in  a  search  area. 

Model  Description  for  ADEPS 

Two  search  methods  are  available  in  ADEPS  (Allison,  1970).  An  area  search  rou¬ 
tine  predicts  effectiveness  from  a  latticed  sonobuoy  pattern  with  equally  spaced  sonobuoys. 
This  routine  includes  the  following  possibilities  for  buoy  placement :  4-4,  2-2-2-2,  3-3-3, 
8-8,  5-6-5,  4-4-4-4,  6-6-6-G,  16-10,  11-10-11,  8-S-8-8.  A  barrier  search  routine 
assumes  that  a  submarine  is  on  a  course  perpendicular  to  a  row  of  sonobuoys.  Only  the 
area  search  method  is  examined  in  this  report. 

hi  the  ADEPS  area  search  routine,  symmetric  characteristics  of  the  sonobuoy  field 
are  used  to  divide  the  field  into  identical  subareas  as  shown  in  Figure  1.  A  lateral  range 
routine  computes  POD  versus  range  values  to  give  the  probability  that  a  sonobuoy  will 
detect  a  target  when  the  target  is  at  a  given  range  from  the  sonobuoy.  Individual  buoy 

o  o  o  o 
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Figure  1.  A  Symmetrical  Subsection  of  a  4-4- 1-1  Buoy  field  in  ADEPS. 

Probability  of  Detection  is  calculated  lor  a  symmetrical  sub- 
area  of  the  buoy  field  and  is  used  as  indicator  of  effectiveness 
for  tile  entire  field. 

lateral  range  curves  are  combined  to  determine  probability  oi  detection  at  equally  spaced 
points  u,  a  subarea.  Conditional  probability  (P(t))  is  computed  from  the  sample  points  in  a 
oubarea  where  Uie  combined  probability  of  detection  is  greater  than  or  equal  to  0.5.  The 
average  distance  D  between  l  onsecutivc  detections  is  computed  by  sampling  each  point 
.sequentially  (as  shown  in  Figure  5i  and  averaging  the  distances  between  uni)  >  0.5  sample 
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In  equation  1,  P(t>  is  n  conditional  probability  of  doted  ion  in  a  subarea  during  time  t. 

P(t>  =  1  -  o  _TU  ftt  0  (  1 ) 

Although  it  is  not  the  probability  that  a  submarine  wall  be  delected  bv  the  entire  sonobuoy 
field,  it  is  a  measure  of  the  effectiveness  of  the  field.  The  final  product  of  the  model  is 
the  average  conditional  probability  of  detection  (PI  given  that  a  target  enters  a  symmetrical 
subsection  of  the  buoy  field,  ft  is  determined  by  averaging  the  values  for  P(t)  over  the  on 
station  time  period. 

Model  Description  for  TASDA 

TASDA  operations  (NADC,  197(>)  are  divided  into  two  functional  objectives:  (1)  crea¬ 
tion  of  a  sonobuov  tactics  file,  and  (2)  application  of  Monte  Carlo  simulation  to  produce 
optimum  sonobuoy  field  deployment  for  ASW  threats.  The  tactics  file  is  created  by  a 
geometry  definition  program  (GEOMT).  TASDA  uses  Monte  Carlo  game  theory  to  stimu¬ 
late  100  random  tracks  of  a  target  through  a  sonobuoy  field  selected  by  GEOMT.  Aircraft 
time  on  station  is  divided  into  time  steps.  The  position  along  a  target  track  is  computed 
for  each  time  step.  If  signal  excess  is  greater  than  zero  for  two  consecutive  time  steps, 
a  detection  is  recorded.  The  frequency  of  detected  target  tracks  to  total  tracks  is  used 
as  an  estimate  of  the  expected  and  cumulative  probability  of  detection.  The  total  time 
a  target  is  detected  bv  one  or  more  sonobuoys  divided  by  the  number  of  unbroken  detec¬ 
tion  intervals  is  output  as  mean  holding  time.  The  time  of  first  detection  for  each  target 
track  is  recorded  and  the  total  of  these  times  divided  by  the  number  of  detected  tracks 
is  output  as  mean  time  to  first  detection. 


Model  Description  for  A/.<  d 

A/.i  >1  (Rirnbaum  and  Dorav,  1!)7M  is  ;i  tactics  package  which  includes  four  subprograms 
<>PTI,  WAIT,  and  CAMP.  Fxpected  probabi lit v  of  detection  <  I- POD)  bv  a  sonobuoy 
field  is  computed  in  LOOP.  OP'1'1  determines  the  pattern  spacing  which  provides  maximum 
!  lain.  WAl'l  calculations  include  cumulative  probability  ol  detection.  ('.AM!  uses  Fp(>!) 
obtained  bv  !  <  a  )|>  to  estimate  an  optimum  buoy  spacing  for  a  given  pattern  with  several 
different  sonobuoy  characteristics,  such  as  figure  of  merit  (F(>Mi  or  buoy  depth. 


In  A/.nl,  Lpol)  is  estimated  by  Monte  Carlo  simulation.  A  lateral  range  curve  of 
probability  of  detection  versus  signal  excess  is  given  bv  a  receiver  operating  curve  (TD)C'i 
which  is  determined  Irom  a  probabiliu  ol  talse  alarm  of  DC  *  and  a  specific  spectrum 
analv/.er  set  lor  a  liyc-miimte  integration  time.  Signal  excess  versus  range  is  deter¬ 
mined  from  the  !•'<  'M  and  the  propagation  loss  curve.  The  two  tables  of  values  are  combined 
to  produce  P(d>  versus  range  values.  Range  from  a  sonobuoy  is  determined  from  a  statis¬ 
tical  target  distribution.  Detection  probability,  Pi,j*  for  the  jt h  sonobuoy  at  range  rj  from 
the  target  is  found  from  POD  versus  range  values  (Figure  .‘ii.  In  equation  2,  Z(Xj,  Yj)  is  the 
expected  value  for  detection  when  the  target  is  at  a  partieidar  position  Yj>«  The  sub¬ 
script  i  is  an  index  used  to  number  target  positions  from  1  to  N. 
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n  =  number  of  sorobuovs 


FPOD  for  a  pattern  is  calculated  bv  talcing  a  random  sample  of  N  target  positions.  Proba¬ 
bility  is  calculated  for  each  position  i  as  in  equation  2.  The  probabilities  are  summed  and 
divided  b\  X  to  calculate  FPOI)  in  equation  2. 
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N  r  number  of  target  positions 

Cumulative  probability  of  detection  (CPt'Di  is  also  estimated  by  Monte  Carlo  simu¬ 
lation.  The  mathematical  function  used  in  the  computation  of  CPOD  is  binomial  aid  gives 
the  probability  ol  at  least  one  detection  in  X  trials.  A  time  tj  is  chosen  randomly  from  a 
time  interval  I  using  a  random  number  generator.  The  interval  I  is  defined  by  equation  A 
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.\r  uncertainty  about  the  target  posi'io.i  at  time  l.  is  calcul  tied  from  a  normal  statistical 
(list  ribution.  Detection  probability  at  a  position  i.-  ■.  airiilrupd  as  in  equation  2.  The  maxi¬ 
mum  expected  value  foj  del  eel  ion  bv  sonobuo.v  i  (Figure  D  over  N  target  tracks  at  each 
time  tj  is  summed  to  yield  cumulative  probability  of  detection  in  equation  a. 
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The  CPOD  in  equation  5  is  an  estimate  for  the  lower  limit  of  cumulative  probability  of  de¬ 
tection  at  time  t.  A  large  number  of  target  tracks  must  be  generated  to  obtain  an  estimate 
of  CPOD  with  a  small  variance.  The  number  of  simulations  required  depends  on  the  signal 
excess  and  the  desired  accuracy  of  output  data.  The  probability  of  detecting  a  target  that 
has  not  yet  been  detected  is  calculated  from  CPOD  using  Bayes  theorem  of  probability. 


Figure  3.  A  Graph  of  POD  vs.  Ttange  Values  Computed  in  the  AZOI  Tactics  Package. 


Figure  4.  Maximum  POD  Pjj*  of  3  Target  Tracks  at  Time  tj  for  a  Sonobuoy  j 
in  AZOI. 
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Model  Description  for  SPAM 


The  SPAM  program  computes  CPOD  bv  Monte  Carlo  simulation  (Marin,  1979).  The 
range  of  the  target  from  a  sonobuov  is  found  bv  a  stochastic  process.  Signal  excess  (SE) 
at  time  t  is  found  from  a  normal  distribution  with  mean  SK(r)  and  a  standard  deviation 
of  <),  s,  10,  or  12  tin.  The  probability  that  the  signal  excess  is  greater  than  zero  at  range 
r  is  given  by  equation  (i  (Marin,  1970. 
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-  =  standard  deviation 
of  signal  excess 

To  vise  equation  0  in  a  simulation  model,  it  is  necessary  to  introduce  a  time  element.  The 
expression  pqtj)  is  introduced  as  the  probability  that  a  target  is  not  detected  at  riuige  rj 
during  time  t;.  I’he  following  equations  are  assumed  for  the  time  element. 
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liquation  7a  states  that  the  probability  of  detection  Pj(tj)  is  proportional  to  some  constant 
A  -  plus  some  higher  order  terms.  The  higher  order  terms  in  equation  7a  can  be  neglected 
for  a  small  time  period  t.  Equation  71)  states  that  the  target  is  either  detected  or  not 
detected  where  the  probability  Mj(0)  of  no  detection  at  any  range  with  no  time  elapsed  at 
that  range  is  one.  Equation  7c  assumes  that  no  detection  at  time  t  and  no  detection  at  time 
t-  At  are  independent  events.  The  assumptions  lead  to  mi  exponential  statistical  distribu¬ 
tion  for  Pj(tj).  The  SPAM  program  uses  the  equation  (Marin,  1977>) 

Pal.  ;  -  1  -  e  for  t  0  -  gt 


in  a  simulation  technique  called  the  cumulative  time  window  (CTW).  The  length  of  time  t() 
necessary  lor  a  sonobuov  j  to  detect  a  target  and  the  length  time  t^  between  time  steps 
are  input.  Probabilities  Pjftjl  are  computed  and  compared  with  random  numbers  to 
determine  when  a  detection  occurs.  A  program  trial  ends  either  when  a  detection  occurs 
or  when  the  aircraft  on  station  time  expires.  The  upper  limit  for  cumulative  probability  of 
detection  is  obtained  b\  combining  single  buoy  probabilities  independently  in  equation  9. 


r,r>  ,r  „),a  f  i ;  •••(:-  Pit,))  (9) 

n  -  number  of  sonobuov  s 

A  lowei  limit  for  probability  oi  detection  at  time  tj  is  obtained  assuming  complete 
dependone*-  as  in  equation  pi. 
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n  =  number  of  sonobuoys 

SPAM  outputs  cumulative  probability  slightly  less  than  hallway  between  the  two  extremes 
using  equation  11. 


CPOD  =  .45  ( CPOD  +  CPOD  ,  ) 
'  max  min 


CPOr 


mi  n 


(11 


Summary  of  Model  Descriptions 

Kuch  of  the  models  calculates  probability  of  detection  at  some  time  tj  in  order  to 
arrive  at  an  estimate  for  KPOD.  ADKPS  calculates  the  average  conditional  probability 
P  in  a  symmetrical  subarea  of  a  buoy  pattern.  TASDA  computes  probability  of  detec¬ 
tion  bv  one  or  more  buoys  (Pl)li  using  Monte  Carlo  simulation  of  100  target  tracks  anti  a 
detect  (POD  -  U  or  no  detect  (POD  -  Oi  analysis  for  each  track.  A/.oi  uses  a  binomial 
distribution  function  to  calculate  KPol)  where  a  value  along  a  time  track  is  chosen  random¬ 
ly.  SPAM  uses  Monte  Carlo  simulation  and  averages  Pj(tj)  (previously  definedl  obtained  by 
assuming  dependence  of  snnobuoys  with  Pj )  obtained  by  assuming  independence  of  sono- 
buovs. 

I  ach  of  the  models  estimates  cumulative  probability  of  detection.  ADKPS  uses  an 
ex)V)iiential  expression  to  estimate  ('POD.  TASDA  uses  a  detect -no  detect  Monte  Carlo 
mathematical  technique.  A/.ol  uses  some  of  the  KPOD  calculations  to  obtain  an  estimate 
for  the  lower  limit  of  CPOD.  In  the  uniform  case  CPOD  is  time  independent  and  is  equal 
to  KPOD.  SPAM  uses  a  cumulative  time  window  (CTW)  defined  by  tQ  and  t^  to  calculate 
CPOD. 


Ill. 


SCFNATMO  III  liNITK  )N 


Five  sonobuoy  patterns  employed  by  ASW  taetieians  were  chosen  lor  data  .uiahsis  in 
seenario  1:  the  circle  (ellipse  in  the  normal  case),  1-1  1-1,  chevron  (chevron  skew  in 
the  normal  ease),  3-0-3,  and  brushlae  patterns.  Their  configurations  are  delinod  in 
Appendix  A.  The  same  input  lor  target  intelligence,  environmental  data,  and  aircraft 
characteristics  were  used  so  as  to  evaluate  the  effectiveness  of  each  pattern.  Output 
was  generated  for  one-half  hour,  one  hour,  and  four  hours  of  flight  time  in  all  cases 
preceding  the  aircraft's  arrival  on-station.  The  aircraft  remained  on-station  four  hours 
in  all  cases  for  scenario  1.  The  circle,  ellipse,  1-4— 1-4  and  chevron  skew  patterns 
were  evaluated  in  scenario  2.  The  on-station  time  was  extended  from  (our  to  l(i  hours 
in  the  second  seenario  and  output  was  generated  for  one  hour  time  late,  hi  scenario  3, 
the  circle,  ellipse,  4—1— 1-4  and  chevron  skew  patterns  were  searched  in  quarters  In 
lour  planes  with  one  hour  time  late  and  lour  hours  on  station.  Scenario  4  used  the 
same  target  data,  buoy  data,  and  aircraft  data  input  as  scenario  3,  however,  environ¬ 
mental  input  was  changed  for  oilier  comparison  purposes. 

Scenarios  1-3  were  based  on  the  following  environmental  input.  An  XBT  temperature 
profile  to  730  meters  recorded  0  July  1971  in  the  Pacific  Ocean  at  latitude  33°  38'  North 
and  longitude  123°  39'  West  was  input  into  the  Integrated  Command  ASW  Prediction  System 
(ICAPS)  PROFGKN  computer  program.  This  program  merged  the  observed  depth- 
temperature  pairs  with  a  deep  historical  protile  to  yield  a  total  temperature  profile  with 
bottom  depth  at  4000  meters.  The  program  then  calculated  a  sound  speed  prolile  from  the 
totiil  temperature  profile  and  historical  salinity  values.  The  sound  speed  profile,  which 
exhibited  a  depth  excess  indicative  of  convergence  zone  environment  (Figure  3),  was  input 
into  the  ICAPS  Fast  Asymptotic  Coherent  Transmission  (FACT)  program  to  determine 
acoustic  propagation  loss.  By  varying  die  target  depths,  receiver  depths,  and  detection 
frequencies  inserted  into  the  FACT  program  nine  propagation  loss  (PL)  curves  were 
generated.  These  curves  appear  in  Appendix  B. 

The  environmental  input  for  scenario  I  was  a  Gulf  Stream  profile  from  latitude  39°  30' 
North  longitude  70°  29'  West  recorded  17  November  1999.  It  was  merged  with  ICAPS  deep 
history  data  to  produce  a  total  profile  with  bottom  depth  2400  meters  (Figure  (3).  An  At¬ 
lantic  slope  water  profile  at  latitude  39°  33'  North,  longitude  71°  30'  West  recorded  18  Nov¬ 
ember  1909  was  merged  to  produce  a  total  profile  with  the  same  bottom  depth  (Figure  7i. 
Two  different  profiles  were  used  in  scenario  1  in  order  to  show  the  effect  of  varying  the 
environment  on  the  tactical  programs.  Since  scenario  1  uses  environmental  input  which 
is  different  from  the  other  3  scenarios,  its  output  docs  not  directly  compare  with  output 
from  the  first  three  scenarios. 
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Figure  f>.  Atlantic  Cult'  stream  sound  speed  profile  used  to  generate  propagation 
loss  curves  for  scenario  4.  (The  predominant  mode  of  sound  propagn 
tion  is  ln_  thrccl  path. ) 
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PROCE SSING  R  EQ U EH  E M E MTS 


IV 


All  tour  tacticxil  sonobuoy  computer  programs  require  buoy  input,  target  input,  and 
environmental  input.  ADEPS  does  not  require  aircraft  input.  Some  input  values  are  preset 
in  each  program  so  that  the  user  need  not  specify  a  long  list  of  values.  Data  processing 
inputs  for  the  four  scenarios  considered  in  section  Y  are  given  in  Table  1. 

Buoy  Input 

Buov  input  which  define  sonobuoy  patterns  for  evaluation  is  shown  in  Table  2.  In 
ADEPS  the  total  number  of  sonobuoy s  input  must  be  a  multiple  of  eight.  Area  dimensions 
are  required  and  are  used  to  calculate  a  buoy  spacing.  The  buoys  are  equally  spaced  to 
cover  an  entire  area.  ADEPS  is  the  most  limited  program  in  terms  of  buoy  input,  but  the 
symmetric  patterns  allow  rapid  processing.  The  only  geometries  available  in  the  ADEPS 
preset  pattern  package,  applicable  for  this  study,  were  the  4-4-4— 4  pattern  and  the  5-6-"> 
pattern  with  a  uniform  target  distribution. 

TASDA  requires  the  number  of  sonobuoy s,  buoy  position  assignment,  the  number  of 
different  spacings,  and  buoy  spacing  limits  as  input.  Patterns  are  input  using  a  sonobuoy 
position  planner  chart.  Optionally,  the  user  may  input  buoy  positions  in  x-y  coordinates  to 
define  a  pattern.  GEOMT  is  a  preprocessor  program  for  TASDA  and  creates  a  tactics  file 
of  up  to  20  sonobuoy  patterns  with  as  many  as  64  buoys  in  each  pattern,  t  his  preprocessing 


Table 

1.  Data  Processing  Requirements 
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N  .iHitc  combines  sio  cases  shown  in  Table  1  info  162  runs  for  processing.  Run  time  and 
buoy  inpur  time  are  reduced  since  buov  positions  are  simply  recalled  from  OEOMT  rather 
t  ban  rout  inch  entered. 


Table  2.  Buoy  Input 


ADEPS 

TASDA 

AZOI 

SPAM 

Coordinates 

X 

X 

X 

Spacing 

X 

X 

X 

X 

Buoy  11  ansformation 

X 

X 

Preset  i bitterns 

X 

Geometries 

X 

Ambient  Noise  SDev 

X 

Li  A ZOI  a  pattern  geometry  is  defined  by  specifying  a  set  of  x-y  coordinates  for  each 
buoy.  A  iactor  for  converting  relative  distance  to  nautical  miles  must  be  specified.  Four 
ty  pes  of  transformations  may  change  the  basic  pattern:  x-spacing  expansion,  y-spaeing 
expansion,  pattern  shift  along  the  x-axis,  and  rotation  of  the  pattern  about  the  origin. 

Li  SPAM  the  user  specifies  the  number  of  sonobuoys  and  the  x-y  coordinates  in  nauti¬ 
cal  miles  for  each  buoy.  Buoy  coordinates  are  input  in  the  order  in  which  the  buoys  are 
deployed.  As  the  buoys  are  dropped,  the  user- specified  radio-frequency  (RF)  range  is 
used  to  determine  if  a  sonobuoy  can  be  monitored.  After  the  pattern  is  complete,  SPAM 
simulates  monitoring  constraints.  The  user  specifies  the  average  number  of  buoys  that 
tui  aircraft  can  monitor  and  the  monitoring  time.  Using  the  value  for  the  average  number 
of  buoys,  the  program  randomly  selects  buoys  from  the  pattern  and  only  these  buoys  will 
be  used  to  determine  if  a  detection  occurs. 

Target  Input 

There  are  twenty  target  inputs  as  shown  in  Table  .3.  Li  ADEPS  only  four  of  the  inputs 
are  applicable.  Target  speed  is  input.  The  area  search  option  corresponds  to  an  evenlv 
spaced  position  input  where  the  target  remains  in  the  search  area  at  fixed  positions.  The 
barrier  search  option  corresponds  to  the  univariate  normal  input  where  die  target  is 
assumed  to  progress  towards  a  barrier  with  a  target  track  perpendicular  to  die  barrier. 
Only  the  evenly  spaced  input  is  used  in  diis  study  to  search  an  area  with  .1  - ( 1  -  A  and  1-1- 1-1 
patterns . 

Twelve  of  die  twenty  target  inputs  apply  to  TASDA.  Target  speed  is  required.  The 
target  type  must  be  specified  as  nuclear  or  conventional,  holding  or  transiting.  A  nuclear 
holding  target  was  used  for  diis  study  (see  Table  1).  Target  location  may  be  described 
in  two  ways: 

1.  A  uniform  time-dependent  density  function  assumes  that  die  target  density  is 
random  over  a  designated  rectangle  (Figure  S). 
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2.  A  Bessel  normal  distribution  function  is  generated  from  an  initial  bivariate 
normal  density  function  that  is  expanded  at  a  rate  equal  to  input  target  speed 
(Figure  !)). 

Both  target  location  functions  were  used  in  this  study. 


Table  3.  Target  Input 


Target  Movement 

ADEPS 

TASDA 

—  "  - 

AZOI 

SPAM 

Course 

X 

X 

Course  Standard  Deviation 

X 

Course  Limits 

X 

Speed 

X 

X 

X 

X 

Speed  Standard  Deviation 

X 

X 

Velocity  Vector 

X 

Conventional 

X 

Nuclear 

X 

Holding 

X 

I  r  tut  si  ting 

X 

Distance  Traveled 

X 

Snorkel  Cycle 

X 

Target  Location  Standard  Deviation 

X 

X 

Initial  Target  Location  Density  Functions 

Evenh  spaced  positions 

X 

Cai fortti  Time -dependent 

X 

l  nitoiin  Time-independent 

X 

X 

l  V:h  ariate  normal 

X 

X  ! 

1  i •  ■  -  ' c  i  norm  id 

X 

X 

Hi\  ariate  normal 

X 

X 

1  mu— dependent  bivariate  normal 

X 

i 

J 

NXtd  uses  seven  ol  twend  target  inputs.  Target  speed  and  speed  standard  deviation 
are  input  di  recti',  nr  m  term.-,  oi  ,i  spee<l  covariance  matrix.  The  following  four  target  loc  a¬ 
tion  :  ;!■  functions  :ot  used  to  predict  initial  target  location  for  Monte  Carlo  simulation: 


RANDOM  TARGET  TRACK 


Figure  s.  Fniformly  Distributed  Initial  Target  Area  in  TASDA.  The 

target  location  is  random  over  a  designated  area.  The  same 
type  of  target  area  definition  is  available  in  AZOI  and  SPAM. 
However,  the  statistical  distribution  is  time-dependent  for 
TASDA. 


Figure  9.  Normally  Distributed  Initial  Target  Area  in  TASDA.  The  ini¬ 
tial  target  location  is  normally  distributed  around  (XPT,  YPT) 
with  standard  deviation  SGMAX  in  the  x-direction  and  SGMAY 
in  the  y  direction.  The  same  type  of  area  definition  is  avail¬ 
able  in  AZOI  and  SPAM.  However,  the  statistical  distribution 
is  bivariate  normal  for  SPAM. 


1.  A  uniform  time-indcix-ndcnt  density  [unction  assumes  that  target  density  is  con- 
sUuit  over  a  designated  area. 

2.  A  Bessel  normal  density  [unction  is  generated  irom  an  initial  bivariate  normal 
density  [unction  ;uid  expands  at  a  rate  equal  to  the  best  estimate  of  target  velocity 

:>.  A  time -dependent  bivariate  normal  density  function  predicts  a  target  position 

when  target  tracking  has  been  successful.  This  function  describes  a  target  being 
tracked  when  it  is  imperative  to  re-establish  target  contact. 

1.  A  bivariate  normal  distribution  function  assumes  that  a  target  is  normally  dis¬ 
tributed  in  an  area  generated  from  a  single  1)1  FAR  buoy  fix,  a  SOSFS  contact,  or 
radar  contact.  This  distribution  does  not  expand  with  time. 

The  first  and  second  functions  were  used  for  uniform  and  normal  cases  in  this  study 
(Table  1). 

SPAM  uses  seven  of  the  twenty  inputs  listed  in  Table  3.  Required  input  is  speed, 
speed  standard  deviation,  course  anti  course  standard  deviation.  Target  location  can  be 
assigned  using  three  distribution  functions: 

1.  A  uniform  time -independent  distribution  function  with  the  property-  that  a  target 
is  equally  likely  to  be  at  any  point  within  a  bearing  box  of  length  L.  and  half¬ 
width  H . 

2.  A  bivariate  normal  distribution  function  which  has  a  user  specified  mean  and 
standard  deviation. 

3.  A  univariate  normal  distribution  function  which  has  a  normal  distribution  in  an 
\  direction  and  a  uniform  distribution  in  a  y  direction. 

Functions  1  and  2  were  used  for  data  analysis  in  this  study. 

Ae<  untie  Input 

Acoustic  input  for  cadi  program  is  listed  in  Table  -1.  The  acoustic  input,  source 
level  (SI.),  ambient  noise  (AX),  :uid  recognition  differential  (RD)  are  used  to  determine 
F(0T  as  in  equation  12. 

ron  !.l  -  •  -  rl-  ;  12 


Probability  of  detection  is  defined  to  be  O.u  when  sigmil  excess  (SE)  in  equation  13  is  zero 
for  jiiopag  xtion  loss  (PI.)  at  range  R. 

!  =  fof  -  n  w-0  1 1: 
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Ln  each  program  a  probability  curve  is  used  to  assign  probability  values  to  values  of  signal 
excess.  When  signal  excess  is  greater  than  zero,  the  probability  values  will  be  greater 
Uian  n..j.  When  signal  excess  is  less  than  zero  probability  values  will  be  less  than  0.5. 


Table  >.  Acoustic  Input 


ADEPS 

TASDA 

AZOI 

SPAM 

Drop  Toss  (HE) 

X 

X 

X 

X 

S-  'll  ret  1  c\  i  4 

X 

\mbieni  Noise 

X 

Recognition  Diflerential 

X 

Figure  ot  Merit 

X 

X 

X 

Multiple  FO.M 

X 

X 

X 

K<  >C  Curve 

X 

Multiple  L’L 

X 

X 

X 

Convergence  Zones 

X 

X 

ADI- .'PS  considers  propagation  loss  (PI.)  curves,  source  level  (SL),  ambient  noise  (AN), 
and  recognition  differential  (it!)),  but  ADEPS  does  not  have  a  provision  for  time  late.  As 
a  result  ADEPS  could  only  be  applied  for  54  of  the  810  possible  cases.  There  is  no  pro¬ 
vision  for  multiple  frequencies  or  multiple  FOMs  and  a  separate  run  was  required  for  each 
case.  In  order  to  reduce  the  number  of  runs,  an  FOM  of  75  was  selected  with  a  frequency 
of  500  Hz,  Eighteen  computer  runs  were  processed  for  scenario  1. 

The  TASDA  program  can  accept  up  to  three  propagation  loss  curves  and  up  to  four 
FOMs.  Those  two  features  reduced  the  number  of  runs  required  from  162  to  18.  The  user 
may  input  convergence  zone  ranges  and  widths  instead  of  propagation  loss  curves. 

In  AZOF,  a  receiver  operating  characteristic  (ROC)  curve  is  required  input.  This 
curve  gives  probability  values  as  a  function  of  signal  excess.  Other  inputs  are  a  table  of 
propagation  loss  versus  range  and  a  figure  of  merit.  Two  subprograms  of  AZOI  were 
modified  in  Max  1!)7s  to  process  multiple  FOMs,  multiple  propagation  loss  curves,  and 
multiple  patterns.  The  number  of  required  data  sets  for  input  were  therein-  reduced  from 
s  10  to  eight . 


-I’Atl  accept  s  i nit'  propac.nl  ion  lit-.-  1 1 ! i  a  1 1 1'  t  rt  '  i.ienci  and  ) eeeii  e r-  -on ri  r  1 1 1 (  It  - 
s|;i  .  cit  pih  identification  mimin  r-.  Am  lumiln  r  of  propagation  loss  curve-  mai  be  inpui 
to  tin  lih  with  an\  nuniin  r  ol  lre<|iutuii  I  1  •  wo. -.ram  automat  ienll  \  searches  t  In  ouch 
l  Ik  input  propagation  loss  till-  i..v  the  appn  -i -ri  at  t  propagation  loss  aim-.  1  hi  main  pro¬ 
gram  SI’AM  was  modified  in  .-«-ptc-mber  laTT  fop  multiple-  I  <>M,  multiple-  time  late,  and 
nvalliple  propagation  loss  input.  I  lie-  numl’ei'  of  execution-  was  reduced  from  HO  to  eight. 

\  propagation  !os-  e-urve-  is  clas-ilicd  a.-  sliallo'1.  -sliallov.  IS-SI  lor  a  shallow  target  and 
i  ,  ci  i\i a  ,  ih  i  p-dei  p  i  I )—  I > i  tor  a  de-e-p  1  -rpi-i  and  receiver,  or  shallow-deep  iS-!)i  for  either 
a  s I-,: : ! lo target  or  reeei ve'r  t >u  output. 

Aire  raft  Input 

A  DHL'S  doe's  not  eonsider  aircraft  parameters  except  lor  monitor  degradation  as  shown 
in  Table  For  TASDA,  tile  flight path  is  described  onI\  lo  Die  extent  of  spec-ill  nig  die 
• -lap-cel  lime  be* fore  arrival  on  station.  The  radio  lroquonci  (RF)  range  is  the  maxinium 
allowable  distance  betwe’cn  die  aircraft  and  a  sonobuoy  which  permits  radio  reception, 
i  or  TASDA.  the  nosition  of  tJic  aiivrail  is  fixed  al  the  center  of  the  field  for  tile  simulation. 
\Z*  i  use-  time  late,  aircraft  velocity,  and  on-station  time  to  calculate  (.'l’(il).  SI’AM  in¬ 
clude.-  tinn-  late-  and  time  on  station  as  well  as  aircraft  ground  speed.  The  user  specified 
ground  speed  in  SI’AM  determines  the-  time  at  which  each  buoy  comes  up.  Onl\  Uiose  buo\  s 
. itiiin  a  user -specified  l!i'  range  are  monitored.  Alter  all  buoys  are  in  the  water,  die  user 
i  an  ..pec-ili  •,  sonobuen  monitoring  scheme  tilth  reflects  RF  constraints. 


Table  •">.  Ui  ertd't  Liput 

1 

1 

-  AIU.PS  i  i  ASDA 

AZOI 

[  SI’AM 

1  It  1  Range 

X 

X 

1  lime  Late 

X 

t 

X 

i 

1  x 

1  Time  on  Station 

X 

,  X 

do  altering  Sequence 

i 

1  X 

■  a  -i.nd  Speed 

i  x 

|o  ill  >'  Degradation 

1 

i 

!  x 

_ L  _J _ 

i 

Sin  : i - ,  -  i a  Min iel  input 

I. a-  ■  oi  '.la  piogram.-  uses  diilereni  mndicmatictd  lot  mulatiuiis  Lo  describe  a  laetieal 
-ih  ali'  w  i  -  oj.en  ocean  -an ironjnent.  Die  formulation:-..  are  based  on  assumptions  about 
die  vtiriat.ci  '  -i.  tlic  ie-.M,  Ui«  amount  ol  signal  e.\ecss  necessary  to  detect  ti  target,  ;u»d  die 
-'epetuli-  ci-  (in  independence)  ol  sonobuoy.-  coll' ‘cti veil  contributing  to  a  detection. 
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u>i  •’  1 1 -i.-  '..1  i-M*t  puff  eras.  Inc  preset  package  crui  not  be  modified.  TASDA  also 
pattern  package,  but  ihc  package  c;w  be  mollified.  AZOI  and  SPAM  have  no 
preset  pattern  files.  A  1)1  PS  lias  n  normal  initial  target  location  distribution.  TASDA, 

V/<  '1  and  SPAM  all  have  options  for  uniform  target  location  distributions  and  normal  loca- 
■  ion  dist  ri  but  ions. 

\P  models  input  a  propagation  loss  curve.  TASDA  may  input  propagation  loss  curves 
at  !’”'!'(>  different  depths.  Therefore,  one  sonobuoy  pattern  may  have  sonobuoys  placed  at 
dilP.  roni  depths.  A/<  >1  inputs  a  receiver  operating  characteristic  (HOC)  curve  which  assigns 
■"  probability  to  values  of  SI  .  In  ADKPS  and  SPAM  this  curve  has  a  normal  density  distri¬ 
ct  ion  with  probabilitv  equal  to  0.5  at  the  mean  of  the  normal  distribution,  in  TASDA 
cumulative  probability  i.~.  determined  from  a  Rician  density  Distribution.  TASDA  assumes 
till  iionoinioys  arc  activated  at  the  same  time.  In  SPAM,  the  user  specified  ground  speed 
dot ei  mines  the  time  each  buoy  comes  up. 

V.  ANALYSIS  <  >r  Rl  srr/rs 

Two  types  of  program  oulpi1'  are  compared  by  this  study:  expected  probability  of  de- 
:  ection  i  KP<  )Dl  and  cumulative  probability  of  detection  (CPOD).  KPOD  follows  the  statistical 
definitions  for  expectation.  ClHiD  is  computed  from  a  probability  density  function  which 
follows  the  statistical  definition  of  a  density  function.  Each  program  uses  different  assump¬ 
tions  to  arrive  at  KPOD  and  different  density  functions  to  calculate  CPOD.  Since  methods 
of  calculations  are  different  in  each  program  the  output  have  different  numerical  values. 

The  analysis  in  this  section  examines  mathematical  techniques  to  explain  the  CPOD  and 
fPnD  numerical  output. 

A  list  of  all  program  output  is  given  in  Table  6.  Although  CPOD  and  EPOD  para¬ 
meters  in  Table  0  are  listed  for  TASDA,  AZOI,  and  SPAM,  numerical  output  for  these 
measures  of  pattern  effectiveness  are  not  the  same.  The  output  values  were  analyzed  in 
reference  to  four  scenarios.  Three  target-receiver  depth  combinations,  shallow-shallow 
(S-S),  shallow-deep  (S-D),  and  deep-deep  (D-D),  were  used  to  generate  propagation  loss 
curves  for  the  first  3  scenarios.  Probability  of  detection  was  predicted  for  three  FOMs  and 
for  a  low  frequency  range,  middle  frequency  range,  and  a  high  frequency  range  in  scenario 
1,  2  and  3.  Scenario  1  uses  two  target-receiver  depth  combinations,  two  frequencies  and 
one  POM. 

Scenario  1 

Expected  probabilitv  of  detection  was  calculated  for  five  patterns  with  a  uniform  and 
normal  initial  target  location  distribution.  Time  late  was  not  a  factor  in  the  uniform  case 
because  that  parameter  did  not  change  the  initial  target  location  distribution  for  AZOI  and 
SPAM.  Therefore,  values  for  1  and  4  hrs  time  late  have  been  omitted  and  only  values  for 
30  min  time  late  appear  in  Appendix  C.  Cumulative  probability  of  detection  was  analyzed 
using  the  method  shown  in  Figure  C-l.  Csing  this  method  cumulative  probability  of  detec¬ 
tion  was  converted  to  a  single  eventual  probability  of  detection  value  for  comparison  pur¬ 
poses.  Both  the  eventual  POD  values  and  the  original  CPOD  curves  appear  in  Appendix  C 
for  TASDA,  AZOI,  and  SPAM.  The  18  CPOD  curves  that  were  generated  for  ADEPS  are 
shown  in  Figure  10  with  the  corresponding  curves  for  TASDA,  AZOI  and  SPAM.  Since 
ADI  PS  could  process  only  two  of  the  patterns  the  results  were  not  analyzed  for  inclusion 
in  Table  7.  However,  the  relationship  between  ADEPS  output  and  output  from  the  other 

iy 


three  models  can  be  deduee<l  from  Figure  10.  one  characteristic  of  the  ADFPS  curves  is 
that  tliev  always  rise  to  100'  I >  1 ) . 


Table  0.  Measures  of  Effectiveness 


ADF  PS 

TASDA 

AZOI 

SPAM 

PROGRAM  OUTPUT 

X 

X 

X 

CPOD 

X 

X 

X 

EPOD 

X 

PD2 

X 

PD3 

X 

MIIT1 

X 

MHT2 

X 

MHT3 

X 

X 

MHFD 

p 

X 

P(t) 

X 

SIGMA 

_ 

x _ I 

_ 

P(DE/NDT) 

C  POD 

I.  POO 

Pl)2 

PD3 

MIIT1 

MIIT2 

MIIT3 

MTFD 


P(t> 


STOMA 

P(DL/XDT) 


l  ni form  <  ase 


cumulative  probability-  as  a  function  of  time  on  station 
expected  probability  of  detection  on  one  or  more  sonobuovs 
probability  of  detection  on  two  or  more  sonobuoys 
probability  of  detection  on  three  or  more  sonobuoys 
mean  holding  time  on  one  or  more  sonobuoys 
moan  holding  time  on  two  or  more  sonobuoys 
merui  holding  time  on  three  or  more  sonobuoys 
mean  time  to  first  detection 

average  conditional  probability  in  a  section  where  die  submarine 
is  assumed  to  be  a  random  target 

cumulative  probability  that  a  submarine  has  entered  part  of  a 
buoy  field  where  signal  excess  SE  is  greater  than  zero 
standard  deviation  of  POD 

probability  dial  a  target  will  be  detected  given  that  it  has  not 
been  detected  in  die  past 


i;p<  d)  \  alues  for  the  uniform  case  were  averaged  over  three  FOMs  and  three  frequen¬ 
cies  and  the  averages  are  present  in  Table  7.  For  a  shallow  target  and  receiver,  TASDA 
.diuws  Pm  1-1- i— 1  pattern  as  most  effective  over  the  frequencies  and  FOMs  with  a  value 
of  "ii. ;•  ;  pnD.  For  the  shallow-deep  target-receiver  combination,  TASDA  shows  the 

chevron  pattern  as  most  effective.  For  a  deep-deep  target  receiver  propagation  loss 
curve,  TASDA  selected  the  chevron  pattern,  ,\7. <  n  selected  the  circle  pattern  and  SPAM 
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Figure  10.  Probability  of  Detection  versus  Flapsecl  Time  on  Station  for 
Scenario  1  with  a  Uniform  Target  Location  Distribution. 
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selected  the  4-4-4-4  pattern  as  most  effective.  Note  that  there  is  very  little  agreement  in 
pattern  selection.  This  is  because  of  the  different  modeling  in  each  program.  Since  the 
patterns  were  defined  at  a  near  optimum  sonobuoy  spacing,  the  models  give  about  the  same 
probability  averages  for  each  pattern  they  evaluate.  However,  the  difference  in  average 
probability  of  detection  from  one  model  to  another  is  very  noticeable.  Differences  in  model 
output  is  as  much  as  34'?  predicting  the  performance  of  the  same  pattern.  Since  there 
was  not  much  difference  in  I' POD  between  the  five  patterns  using  one  model,  the  number  of 
patterns  considered  was  reduced  to  two.  Only  the  circle  and  4-4-4-4  pattern  were  pro¬ 
cessed  in  subsequent  scenarios. 
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Normal  Case 


l  ime  late  is  a  factor  for  I  POD  in  the  normal  case.  The  time  it  takes  an  aircraft  to 
arrive  on  station  changes  the  distribution  for  initial  target  location.  At  time  late  equal 
zero  TASDA,  AZoi,  and  sl’A.M  all  have  the  same  normal  target  location  distribution  as 
shown  in  Figure  11.  At  .‘10  min  time  late,  t he  normal  distribution  spreads  out  as  shown 
in  Figure  12  and  figure  1.1.  After  .‘>0  min  the  probability  that  the  target  is  at  the  original 
estinuited  position  is  smaller.  Since  the  target  location  distribution  does  change,  the 
eventual  probability  of  detection  values  are  different  for  each  time  late.  1'hese  values  are 
given  in  Appendix  D  under  Normal  Case.  In  this  study  normal  case  output  C POD  values 
were  averaged  over  three  I'nMs  and  three  frequencies  ;tnd  over  each  time  late.  Table  7 
Minus  averaged  values.  The  three  sets  of  output  show  that  AZOI  is  consistently  the  most 
optimistic  of  the  three  programs.  This  is  a  change  from  the  uniform  case  where  SPAM 
was  the  most  optimistic.  As  in  the  uniform  case,  the  averaged  values  were  very  close 
for  different  patterns  using  the  same  model.  The  ellipse  and  chevron  skew  patterns  were 
processed  subsequent  scenarios. 


Scenario  2 

Cumulative  probubilitv  of  detection  was  calculated  for  two  patterns  with  a  uniform  and 
normal  initial  target  location  distribution.  The  first  flight  arrives  on  station  after  one 
hour  time  late  ;uul  remains  on  station  for  four  hours.  A  standard  deviation  in  target  speed 
ia  introduced.  The  last  three  flights  arrive  on  station  with  no  time  late  and  remain  on  sta¬ 
tion  for  tour  hours,  i  his  scenario  is  simulated  bv  a  computer  run  with  one  hour  time  late 
.giil  PI  hours  on  station. 

Tim  values  in  I  able  *  were  obt .lined  bv  examining  CPOD  curves  and  attaching  a  numeri¬ 
cal  v  ,.lue  to  each  curve.  In  order  to  arrive  at  a  numerical  value  the  slope  of  the  curve  and 
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DISTANCE  (nm) 


Figure  12.  Normal  Target  Location  Distribution  for  TASDA 
and  AZOI  at  30  min  Time  Late. 


DISTANCE  (nm) 


Figure  13.  Normal  Target  Location  Distribution  for  SPAM 
at  30  min  Time  Late. 


its  maximum  value  should  he  considered.  A  numerical  value  based  on  area  under  a  curve 
was  used  since  area  under  a  curve  depends  on  rise  lime  and  curve  height.  For  example,  in 
Figure  11,  C  urves  A  and  15  rise  to  the  same  probability  of  detection  equal  to  20.  s.  However, 
curve  \  rises  to  that  I’nl)  faster  than  curve  I!  and  has  a  higher  numerical  indicator  attached. 
In  Figure  la,  curve  ('  rises  as  fast  as  curve  A,  hut  curve  C  rises  to  a  smrdlf  r  I>n[)  niaxi- 
mum.  Therefore,  the  tactic  associated  with  curve  \  has  a  higher  measure  of  effectiveness 
than  curve  ('  and  thus,  has  a  higher  numerical  indicator. 

The  area  under  the  (Pol)  curves  was  estimated  b\  visually  inspecting  the  curves.  The 
method  used  to  calculate  the  ('Poll  curve  indicator  values  is  shown  in  Figure  (  -2  in  Appen¬ 
dix  ('. 

t  nilorm  Case 

('!’» >0  indicator  values  for  tin;  uniform  case  were  averaged  over  three  f  t  iMs  and  three 
t ret |u cncics,  and  the  averages  are  presented  in  Table  Hie  indicator  v  alues  lor  each 
curve  are  shown  in  Appendix  ('.  In  this  scenario  onlv  two  patterns  were  considered  and 
computer  output  showed  only  partial  agreement.  However,  it  is  important  to  remember 
that  in  the  uniform  ease  initial  target  position  is  unknown.  For  all  three  models  indicator 
values  fell  within  a  few  percentage  values  of  each  other  for  the  (-1—1—1  and  circle  patterns. 
However,  the  difference  between  models  is  as  much  as  ;>7  in  the  I)- 1)  case  and  i>  notice¬ 
able  in  all  eases. 

Normal  Case 

Cl’i  dl  indicator  values  for  the  normal  case  were  averaged  over  three  FOMs  and  three 
frequencies  and  the  averages  are  shown  in  Table  s.  The  indicator  values  are  shown  in 
Apncndp-  c.  In  this  case,  initial  target  location  points  are  clustered  toward  the  center  of 
Fie  operation  area  for  I  \s|)  v/o[  and  SP.vM.  tine  would  expect  these  three  models  to 

•  •valuate  1 1  e  Kikoins  -  imiiarlv  since  there  i<  now  some  eonirol  on  target  location.  I  able  8 

•  row  ••  av  er-n.e  prob  ibilitv  ot  detection  value-;  rt-main  noticeably  different.  Note  that  t he 

:  "iMereiWe  i-  i  i  ><<i  'iu  S- 8  -ieplii  with  the  ellipse  whereas  in  the  uniform 

1  t-  a  i  m  i,:-,  rliffei  era «  j-i  «-i  u.e  circle  no  the  S -S  depth.  This  relationship 

’  v  'lit  firenct-s  can  be  observed  for  hot  h  pal  terns  at  nil  depths.  The  long  on  station 
t  i  *  •  '  1-  '"ii'is  appear.-,  to  ha  .  c  an  a  fleet  on  t  lie  large  differences. 


'  '•  1  v  t.  piobal-ilitv  ->i  i!«*toetir.n  easu:d  was  calculated  for  two  patterns  with  a  uni- 

;  i  ••  iiinl  i:  1 1 . :  ■  1  t  1  rget  location  'list  ri’f.tior.  tour  flight  s  arrive  on  station  with  l 

•  •' t  :n  b  i-i.mnii.  on  station  for  loin-  hours,  !  a<T  fligir  searches  ;i  qundrtint  of 

'  >  ■  ■  ’  belli,  since  tin  sonobaov  patterns  ar-  .<  m metric  with  respect  to  the  center 

■I  ,  •  :  if !  i  <  |U ,  o  I  r  :u  it  has  an  i'uniical  ao.inbunv  geom rv.  Theieforc,  only  computer 

-in.  !  i,o  on  out  quadrant  wore  m.-cessarv.  Instead  of  obtaining  C  Pol)  indicator  values 
■  ;  a  .  .  -p.  .-ting  cur  es.  av.  rage  v  alues  were  obtained  b\  dividing  the  (''!’•  >1)  curves 

'o  lion  ■  i  ••  -  shown  in  IT  ni «  ■  .  of  Appendix  >  .  ('  ['( >1 )  indicator  values  foi  the  uni- 

t* * t  ii-  •:  "  ai  I  case  vvi  \  >■  ,ve  r  wed  over  three  F<  Al.s  and  three  frequencies  and  are 
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Figure  1-1,  *  jrves  A  and  B:  Numerical  Value  for 
Pattern  Selection  by  Rise  Time. 
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Figure  15.  Curves  A  and  C:  Numerical  Value  for 
pattern  Selection  by  FPOD. 
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In  the  uniform  case  results  in  Table  h  show  that  there  are  still  significant  differences 
in  mode!  outputs  at  all  depths.  However,  shortening  the  on  station  time  appears  to  have 
brought  the  values  closer  together  in  the  normal  case.  There  is  only  2.3'  maximum  dif¬ 
ference  at  the  S-S  depth. 


Scenario  I 

The  circle  and  chevron  skew  (Appendix  At  buoy  fields  were  considered.  1  he  environ¬ 
ment  was  i  itmged  from  the  Pacific  to  the  Atlantic  for  a  different  type  of  comparison.  1'he 
sound  speed  profiles  in  1  igurcs  ‘j  and  •'!  show  that  there  is  no  CZ  so  sound  propagation  is 
by  direct  path.  The  propagation  loss  curves  in  Appendix  B  indicate  bottom  bounce  is  present 
with  a  P  -inn  ft  source  receiver  depth  combination.  Values  in  Table  10  show  average  !■<  d) 
<  aloes  obtained  'or  the  Atlantic  environment.  Hydrophone  depths  of  100  and  1000  ft  were 
chosen  lot  simulation  and  the  results  art  shown  in  Table  10. 

T'<‘  '  s .  ena  ii<>  was  chosen  t..  show  how  the  models  respond  in  a  d,:e-ot  path  environment. 
As  (  \p<  ced,  a  .ah  es  a  re  I  >wer  than  in  the  other  scenarios  because  of  the  absence  of  a 

convert  <  n*  <■  /oi  c  on  iron  men: .  I  he  one  noticeable  result  jn  the  output  av  eraged  in  I'able 

10  i-  tV  evaluation  bv  AZ<  i|  using  the  chevron  skew  pattern  in  the  normal  case.  Actu¬ 
ally,  thi  i  "  '■  :  one  w  >u Id  p ret !i»  t  for  t  he  chevron  skew  pattern  since  the  coverage  is 

greatest  it  th<  copter  where  the  target  is  most  likeiv.  i  he  other  two  models,  however, 
did  not  ‘•.crease  i  ad  i  prediction  -  significant  1\  from  the  uniform  case. 


Table  10 

Percent  1’rolabilitv  of  Detection  for  Scenario  A 


KNIKOKM 

CASK 

S-S 

D-D 

tit  ITS 

1  II  KAM 

ClliCl  1 

(TASDA  i 

in.  i 

s.  7 

CHIC  11 

t  \ZOIi 

2s.  6 

2*.  1 

>  CIKCIT 

(SPA.Mi 

2s.  7 

2.1.  7 

SKI  )1>K 

w  \tkr 

CIRC!  I- 

(i .  0 

S.4 

CHAU 

21 . 1! 

2I>.  7 

CIUC1.1- 

2.2.1 

2,0.  7 

NORMAL  CASK 

S-S 

D-D 

CiCI.K  STR  KAM 

CHEVRON  SKEW 

2s.  s 

12.3 

CHEVRON  SKEW 

67.2 

20.  0 

CHEVRON  SKEW 

2-1.  1 

22.  0 

SLOPE  WATER 

CHEVRON  SKEW 

10.  1 

0.  1 

CHEVRON  SKEW 

41.  " 

26.  1 

CHEVRON  SKEW 

22.  0 

22. 1 

\ ! .  coxc  i.csioxs 

l.xpected  probability  of  detection  is  calculated  using  four  different  methods.  ADKPS 
calculates  the  are  rage  conditional  probability  in  a  symmetrical  subsection  of  a  buoy  field 
pattern  where  the  submarine  is  assumed  to  be  a  random  target.  TASDA  computes  prob- 
ability  of  detection  bv  one  or  more  buoys  using  Monte  Carlo  simulation  of  100  random 
tracks  through  a  buov  field  and  a  detect  (POD  ;  It  or  no  detect  (POD  -  Ot  analysis  for 
each  track.  A/.<  >1  uses  a  binominal  probability  function  to  calculate  KPOD  where  a  value 
tor  time  along  a  track  is  chosen  randomly.  SPAM  uses  a  Monte  Carlo  simulation  and 
calculates  )  pi  >D  bv  averaging  a  probability  obtained  through  assuming  independence  of 
buovs  A’ith  a  probability  obtained  by  assuming  complete  dependence  of  buoys,  since  the 
method-  of  calculation  are  different  in  each  program,  the  output  for  PPOI)  is  not  exactly 
the  same. 

ADI  Ps,  TASDA,  A/.'  >!  and  SPAM  all  calculate  cumulatiye  probability  of  detection  as 
a  function  of  time.  However,  l he  method  of  calculation  is  different  in  all  four  programs. 
ADI  PS  uses  an  exponential  expression  to  estimate  a  conditional  cumulatiye  probability 
pa  i  as  discussed  in  Section  l.  TASDA  uses  a  detect  -  no  detect,  Monte  Carlo  methodologv. 
A/ol  uses  I  Pi  >D  calculation  to  obtain  tin  estimate  for  the  lower  limit  of  CPOl),  In  the 
case  where  the  target  location  is  assumed  to  hare  a  uniform  distribution,  the  C POD  does 
not  change  with  time  and  is  equal  to  I  P<  ill.  In  the  normal  case,  KPOD  and  CPOD  are  dif¬ 
ferent  since  calculations  for  the  normal  case  are  time  dependent.  SPAM  uses  a  cumulative 
time  window  to  limit  Pi  >1)  calculations  for  CPOD.  Since  different  techniques  are  used  for 
each  program,  it  is  not  expected  that  CPOD  output  will  be  exactly  the  same  for  each  pro¬ 
gram.  ADKPS  outputs  P  and  Pit);  TASDA  outputs  CPOD,  I  POD  and  mean  time  to  first 
detection  (M  l'PDi:  AZoI  outputs  CPOD,  I  Pol),  standard  deviation  (STC.MAt  and  probabil- 
itv  that  a  target  will  be  detected  given  that  it  has  not  been  detected  in  the  past  (P  1 ) I  'XDTt; 
spAM  outputs  Cp(il)  and  I  pnl).  Although  the  symbols  CPOD  and  KPOD  in  Table  •>  are 
used  for  TASDA,  AX<  d,  and  SPAM,  the  output  for  these  parameters  may  not  be  the  same. 


m  K  >)  li  .wing  conclusions  art  indicalt  <1  I)'.  tlii^  -liidi. 


!.  TASPA  i-  ( 'misery  :iti\ e  at  low  l'(  iMs 

I  nlike  A’/.t  i]  or  s|’AM,  I  \SI)A  requi  irs  out  act  timing  two  consecutive  time  steps 
before  ;i  lit  tti.  lion  is  made.  I  ASDA  constructs  probability  areas  around  each  buov  Ijounded 
li\  tv:.,  concentric  circles  as  in  pigurc  1<>.  I  best  areas  repre  sent  the  locations  where  the 


.  TIME  STEPS 

1_  l  i_  l  1  I  l  1  1  1  I  I  I 

TARGET  TRACK 


I  IKST 

CON VI  U(.L  NU 
ZONE 


I/6DAOI  ll.criON  POINTS 

.  4  , 

I  I  A  l  l  .  ^  „ 


DIRECT 


PATH 


l-'itai re  lb.  Target  i'raok  for  I'ASDA  an. I  SI  >  fi  Region  Around  a  Sonobuov.  I>(  il)  =  1. 

signal  excess  SP  is  greater  thiin  Zero.  II  the  target  remains  in  one  of  those  areas  during 
two  consecutiv  c  time  steps,  then  the  l’<  i|)  1  for  that  time  period.  <  itherwise,  t  he  l>(  >|)  = 

<\  There  will  ho  a  set  of  these  values  for  each  of  the  100  1  ASDA  trials.  The  values  are 
summed  c  ei  100  trials  to  conic  up  with  t'l't  >!)  values  for  etich  time  interval.  At  low  rolls 
t he  areas  hounded  bv  concentric  circles  become  verv  small  ai id  as  a  result,  the  C'Pnl) 
values  drop  rapidly  to  zero.  A'/.t  »I  and  SI* AM  compute  pnD  versus  range  for  each  buoy 
rather  than  assigning  a  0  or  1  value  at  a  particular  range. 

SPAM  is  i  iptimistic  at  I.ow  i  i  Als 

If  the  target  >r  at  a  r;mgc  such  that  a  faint  line  will  lie  created  on  a  gram,  then 
there  trust  be  some  .amount  of  time  dining  which  the  target  remains  at  a  detectable  range 
in  order  for  the  operator  to  <ee  a  line;  call  it  t0.  !•  wen  alter  t,Q  time  has  passed,  the  oper¬ 

ator  nav  no'  see  the  line.  I'hc  probability  Ih.al  the  operator  sees  the  line  increases  up 
until  -o  me  time,  t7.  Fhose  Pro  values  for  time  are  incorporated  into  a  cumulative  time 
window  TC’i  W  i  model  which  examines  the  probabilities  between  these  times  in  increments 
of  t  i  me  1 1 .  Ihe  smaller  the  value  of  ty,  the  higher  *  he  1  ’( d )  value.  Stand;;  rd  operating 
values  fm  <1 'AM  arc  (to,  *1.  '■/>  -  t'.-  i,  . . 50|.  This  means  that  the  target  must  re¬ 
main  at  a  detectable  ranee  bo-  onlv  I  ”,  minutes  to  achieve  the  probability  c  detection  pro  - 
>lictei;  b\  tie  standard  passive  .sonar  equation.  I  lie  v  alues  Iq,  i  j  ,  in  the  CTW  caused 
pi  tidicl  io  ■>,  for  SPAM  to  be  optimistic  at  low  Ki  )Ms.  Detection  can  occur  at  any  time 
before  or  after  to,  depending  on  chance. 

.'t.  SPAM  Results  arc  more  Conservative  at  High  Ft  iMs 

I'iie  ( '  P\V  model  builds  detection  probabilities  experimentally  for  a  target  re¬ 
maining  at  a  fixed  range  unP;  timi  'z  with  the  probability  predicted  bv  the  sonar  equation 
aehie.  •  t  after  time  t„  has  pa  ;s«l.  Fhis  function  a, so  smoothes  the  jump  from  low  prob- 
abilitie  associated  with  iow  !•(  'Ms  to  high  probabilities  associated  with  high  ROMs. 


•I.  I  \SI)A  and  A7.<  >1  Show  a  lump  in  (TO!)  as  I'OM  Increases 


A  normal  distribution  around  the  figure  of  merit  is  used  in  the  SPAM  model. 

The  belief  is  that  the  area  under  a  normal  curve  is  equal  to  the  probability  of  detection. 

SI  =  0  when  Ft  iM  -  PI..  At  that  point  there  is  a  50r,'  POD.  As  shown  in  Figure  17, 

SPAM  P(d)  gradually  increases  as  SF  increases.  Truncation  has  an  effect  on  CPOI)  values 
for  A/or  with  low  FOMs.  For  low  FOMs  there  is  very  little  signal  excess  and  probability 
depended  on  the  left  half  of  the  curves  above;  therefore,  the  CPOD  values  dropped  quicklv 
to  0.  TASDA  uses  a  Kician  Distribution  to  simulate  short-term  fluctuation  in  the  PI.  curve 
and  calculations  arc  based  on  the  assumption  that  below  the  FOM  an  operator  is  unlikely 
to  detect  a  target.  Detection  is  either  YFS  or  NO  based  on  SF  0  after  employing  the  TIician 
fluctuations.  As  is  apparent  from  the  graphs  in  Figures  17,  18  and  19.  AZOI  and  TASDA 
have  probability  distributions  which  drop  off  quickly  to  zero  below  the  FOM.  Therefore, 
TASDA  and  AZOI  exhibit  breaking  points  when  the  FOM  reaches  a  small  enough  value.  At 
these  FOMs  (  POD  falls  rapidly  to  zero. 


r>.  AZOI  Shows  Small  Variance  Between  Patterns 

AZOI  differs  from  TASDA  and  SPAM  in  that  TASDA  and  SPAM  use  successive  time 
steps  along  a  target  track  for  a  particular  trial.  After  a  track  has  been  generated  for  a 
particular  trial,  AZOI  picks  random  points  along  that  track  and  evaluates  POD  values  at 
those  points.  Therefore,  the  time  increments  are  not  evenly  spaced  but  randomly  spaced. 

At  each  (joint,  the  range  to  each  buoy  is  calculated  and  the  probabilities  associated  with 
each  buoy  are  summed  to  give  a  POD  for  the  target  at  a  point  along  the  track.  In  this 
manner,  all  contributions  arc  considered.  The  probability  at  a  point  along  the  track  is  not 
zero  or  one  as  with  TASDA,  nor  is  execution  terminated  when  a  detection  is  encountered  as 
with  SPAM.  So  this  method  yields  more  values  for  POD  along  a  track;  and  a  cumulative 
time  window  is  not  employed  as  is  the  case  with  TASDA  and  SPAM. 

These  five  differences  in  the  three  computer  simulation  models  result  from  various 
interpretations  of  the  tactical  sonobuoy  situation  under  consideration.  These  interpretations 
result  in  different  output  values  for  each  of  the  three  simulation  programs. 

The  large  differences  between  computer  models  require  further  investigation.  Future 
studies  should  be  based  on  a  real  world  application  of  the  sonobuoy  programs.  Heal  world 
mission  planners  usually  have  SOS  IS  or  other  intelligence  information  for  input  to  the 
model  and  are  interested  in  POD  versus  buoy  spacing.  The  output  data  sets  in  this  report 
are  not  designed  to  reflect  a  real  world  application  of  the  sonobuoy  programs,  but  acquaint 
the  reader  with  the  amount  and  type  of  data  output  generated  by  considering  a  few  pattern 
configurations  under  several  different  conditions. 
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Figure  17.  SPAA! :  POD  vs  SK  Used  in  the  Calculation  of  a  Lateral 
Range  Curve  (Normal  Distribution). 
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Figure  18.  AZOI:  I>()D  vs  SL  Used  in  t lie  Calculation  ol  a  Lateral 
llange  Curve  (ROC  Curve). 
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Figure  lb.  A  VDA:  I'('D  vs  SI  I 'sei I  in  the  Calculation  of  a  Lateral 
•  lanae  (  mve  (Detect -No  Detect  Assumption). 
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Figure  A-l.  Circle  pattern  used  in  scenarios  1,  2,  3,  and  -4 
for  a  uniform  target  distribution. 
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Figure  A ~2.  Ellipse  pattern  used  in  scenarios  1,  2,  3,  and  4 
for  a  normal  target  distribution. 
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Figure  A-3.  4-4-4-4  pattern  used  in  scenario  1  for  a  uniform  and 
normal  target  location  distribution  and  in  scenarios  2, 
3  and  4  for  a  uniform  distribution. 
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Figure  A-4.  chevron  or  X  pattern  used  in  scenario  1 
for  a  uniform  target  distribution. 


figure  A-  >.  chevron  skew  pattern  used  in  scenarios  1,  2,  2,  and  4 
for  a  normal  target  distribution. 
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figure  A-G.  3-G-3  pattern  used  in  scenario  1  for  a  uniform 
and  normal  target  location  distribution. 
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Figure  A-7.  Brushtac  pattern  used  in  scenario  1  for  a  uni¬ 
form  target  distribution  and  for  a  normal 
target  distribution. 
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APPENDIX  B 


PROPAGATION  LOSS  CTKVLS 
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Figure  13-2.  Propagation  loss  curves  at  a  shallow  receiver  depth  and  deep 
source  depth  for  scenarios  1,  2,  and  3. 
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B-4.  Propagation  loss  curves  exhibiting  direct  path  sound  transmission 
with  no  convergence  zone  used  as  input  to  the  tactical  models  in 
scenario  4. 
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1  hi-  appendix  contains  a  summarv  of  the  computer  runtime  for  each  ol  the  scenarios. 

[t  should  he  no'ed  that  the  runtime  for  A/.<  >1  includes  the  calculation  ot  l>  I)F  NOT  in  addi¬ 
tion  to  i  l>n|)  and  t'l’til).  Also,  AZ(  >1  includes  pattern  processing  time.  Runtime  must 
lx.  miltiplied  In  a  factor  of  <>0  when  estimating  minicomputer  limlime.  Therefore,  the 
values  can  he  considered  in  hours  rather  than  minutes  when  making  minicomputer  run¬ 
time  estimates. 

Also  in  this  appendix  are  the  original  data  generated  hv  the  programs  (Figures  C'-l 
through  C ' - ( > 2 * .  The  data  are  presented  in  graphical  form.  The  original  data  were  reduced 
to  single  I  POi)  and  CI’OI)  indicator  values  for  the  purposes  of  program  comparison  in  this 
report.  The  method  for  obtaining  the  indicator  values  is  shown  in  Figures  C-ti.'J,  C'-til, 
('-no.  The  deriv  ed  indicator  values  for  each  FOM,  frequency  and  depth  combination  are 
listed  in  the  tables  in  the  appendix.  These  values  were  averaged  to  obtain  values  for 
analysis  in  the  text  of  this  report. 


C'-l 
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Table  (  -1.  Runtime  psinn 
The  I'nivae  ll()s  Computer 


CPP  lime 

l/( )  Time 

Total  lime 

Scenario  1 

TASDA 

til.  7  min 

1.  o  min 

2  min 

A >1 

1  s0.  ti  min 

.  3  min 

H'.  n  min  i 

SPAM 

lit).  0  min 

1.  j  min 

1  1  1 .  j  min 

x 

Scenar.o  2 

I  ASI  'A 

17.  0  m  in 

1.  2  min 

1.2  min  1 

A/t  T 

ID.  o  min 

.  2  min 

)t;.  t)  min 

SP  \  .M 

2:;..'!  min 

0.  t)  min 

21.  2  min 

| 

Sivnario 

1 

1  ASI  i.\ 

ti.  <>  min 

1. 1!  min 

7 .  D  min 

A/a  *i 

M .  o  min 

.  3  min 

M .  ti  min 

SPAM 

12.  1  min 

.  S)  min 

ID.  0  min 

S(  \ 

. 

r  AS!  )A 

iv» in 

2.  2  min 

7.  i)  min 

A/.OI 

1  2.  7  min 

.  ti  min 

12.  ()  min 

SP\M 

ll.fi  miai 

.  7  min 

12.  .7  min. 

_ _ _ i 

''he  output,  u  -hM  to  construct  yraplis  ol  the  original  d;tta  was  obtained  from  compute' 

!i  ins  o  i  set  time  inter' .  als  for  each  model .  I  A  SI)  A  outputs  ('  I  ’<  >1 )  values  in  i  nc  ronton ;  s 

tin  of  an  hour,  l  ime  latte  is  a  direct  input  for  TASDA.  The  user  specifies  Target 

s; -et . I,  am!  Distance  !  ravelled  ‘w  target  while  aircraft  is  or.  station.  Time  on  station  is 
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Figure  C  15.  Comparison  of  !  \ S 1) A  .  A/.OI  :iml  SPAM  with  a  uniform  initial 
target  location  at  50  minutes  time  late  with  a  deep  tar  net  and 
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SCENARIO  4  -  UNIFORM  CASE 
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Figure  C  -  57 .  Comparison  of  TASDA ,  AZOI  and  SPAM,  with  a  uniform  initial 
target  location  at  one  hour  time  late  with  a  receiver  frequency 
of  100  Hz  in  the  slope  water  environment  in  scenario  4  using 
the  circle  pattern. 
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Figure  C  58.  Comparison  of  l'ASDA .  A  7.01  and  SPAM,  with  a  uniform  initial 
target  location  at  one  hour  time  late  with  a  receiver  frequency 
of  >100  Hz  in  the  slope  water  environment  in  scenario  1  using 
the  circle  pattern. 
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Figure  C-59.  Comparison  of  TASDA,  AZOI ,  and  SPAM  with  a  normal  initial 
target  location  at  one  hour  time  late  with  a  receiver  fre<|ueney 
of  100  Hz  in  the  Gulf  Stream  environment  in  scenario  -1  using 
the  chevron  pattern. 
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target  location  at  one  hour  time  late  with  a  r, 
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Figure  C-03.  Scenario  1  -  Kventual  Probability  of  Detection  for  a 

shallow  target  and  receiver.  The  eventual  HOD  value 
is  t!  ■*  maximum  C  HOD  attained  by  the  curve.  Kventual 
HOD  is  obtained  by  observing  the  maximum  HOD  for 
each  CHOD  curve.  These  maximum  values  are  summed 
over  frequency  and  FOM  to  give  a  percent  HOD  for  a 
uniformly  distributed  shallow  target  and  a  shallow 
receiver.  Not  for  example:  (.14  +  .50  +  .96  -*  .  22  + 

.58  +  .86  4  .21  +  .26  •  ,76)/9  =  49.9. 
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Table  t'-3:  Scenario  1 
Kventual  Probability  of  Detection 
for  i  Uniform  Target 
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Table  C-9:  Scenario  1 
Eventual  Probability  of  Detection 
for  a  Normal  Target 

at  1  Hr  Time  I.ate:  Shallow  -  Deep  Case 
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Table  C 10 :  Scenario  1 
Kventual  Probability  of  Detection 
for  a  Normal  Target 
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Table  (  -12;  Scenario  1 
Kventuiil  Probability  of  Detection 
for  a  Normal  Target 

at  4  hrs  lime  Late:  shallow  -  Deep  Case 
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Table  C-12:  Scenario  1 
Eventual  Probability  of  Detection 
for  a  Normal  Target 
at  4  Hrs  Time  Late:  Deep  -  Deep  Case 
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Figure  C-04.  Scenario  2:  Average  Probability  of  Detection  a  shallow 
target  and  receiver.  The  average  POD  value  is  obtained 
b\  visually  estimating  the  area  under  the  C'l’oD  curve. 
These  average  values  are  summed  over  frequency  and 
FOM  to  give  a  percent  Pol)  for  a  uniformly  distributed 
shallow  target  and  a  shallow  receiver.  Note  for  example: 
(.11  ■  .  19  .hi  .15  4  .47  .38  +  .11  .17  '  .05)/9  = 
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Table  U-13:  scenario  2 
Average  Probability  of  Detection 
for  a  Uniform  Target 
at  1  Hr  Time  Late 
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Figure  C-65.  Scenario  3  and  4:  Average  Probability  of  Detection  for  a 
shallow  target  and  receiver.  The  average  POD  value  is 
obtained  by  summing  the  POD  values  at  each  time  incre¬ 
ment  .and  dividing  by  the  total  number  of  time  increments 
to  estimate  the  area  under  the  CPOD  curve.  The  average 
values  are  summed  over  frequency  and  FOM  to  give  a 
percent  POD  for  a  uniformly  distributed  shallow  target 
and  a  shallow  receiver. 
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